A Compromise Programming Approach to multiobjective Markov Decision Processes
نویسندگان
چکیده
A Markov decision process (MDP) is a general model for solving planning problems under uncertainty. It has been extended to multiobjective MDP to address multicriteria or multiagent problems in which the value of a decision must be evaluated according to several viewpoints, sometimes con°icting. Although most of the studies concentrate on the determination of the set of Pareto-optimal policies, we focus here on a more specialized problem that concerns the direct determination of policies achieving well-balanced tradeo®s. To this end, we introduce a reference point method based on the optimization of a weighted ordered weighted average (WOWA) of individual disachievements. We show that the resulting notion of optimal policy does not satisfy the Bellman principle and depends on the initial state. To overcome these di±culties, we propose a solution method based on a linear programming (LP) reformulation of the problem. Finally, we illustrate the feasibility of the proposed method on two types of planning problems under uncertainty arising in navigation of an autonomous agent and in inventory management.
منابع مشابه
کاربرد برنامهریزی مصالحهای در مدیریت منابع کمیاب: مطالعه موردی منابع آب زیر زمینی در شهرستان رفسنجان
This study shows how multiobjective programming, compromise programming and filtering techniques could be used to manage scarce resources. Data were collected from a sample of 109 Rafsanjan pistachio producers. The aim of the program was to make a compromise between the objectives of profit maximization, the maximization of the area under pistachio gardens and also maximization of the groundwat...
متن کاملکاربرد برنامهریزی مصالحهای در مدیریت منابع کمیاب: مطالعه موردی منابع آب زیر زمینی در شهرستان رفسنجان
This study shows how multiobjective programming, compromise programming and filtering techniques could be used to manage scarce resources. Data were collected from a sample of 109 Rafsanjan pistachio producers. The aim of the program was to make a compromise between the objectives of profit maximization, the maximization of the area under pistachio gardens and also maximization of the groundwat...
متن کاملFUZZY GOAL PROGRAMMING TECHNIQUE TO SOLVE MULTIOBJECTIVE TRANSPORTATION PROBLEMS WITH SOME NON-LINEAR MEMBERSHIP FUNCTIONS
The linear multiobjective transportation problem is a special type of vector minimum problem in which constraints are all equality type and the objectives are conicting in nature. This paper presents an application of fuzzy goal programming to the linear multiobjective transportation problem. In this paper, we use a special type of nonlinear (hyperbolic and exponential) membership functions to ...
متن کاملOn Finding Compromise Solutions in Multiobjective Markov Decision Processes
A Markov Decision Process (MDP) is a general model for solving planning problems under uncertainty. It has been extended to multiobjective MDP to address multicriteria or multiagent problems in which the value of a decision must be evaluated according to several viewpoints, sometimes conflicting. Although most of the studies concentrate on the determination of the set of Pareto-optimal policies...
متن کاملModified FGP approach and MATLAB program for solving multi-level linear fractional programming problems
In this paper, we present modified fuzzy goal programming (FGP) approach and generalized MATLAB program for solving multi-level linear fractional programming problems (ML-LFPPs) based on with some major modifications in earlier FGP algorithms. In proposed modified FGP approach, solution preferences by the decision makers at each level are not considered and fuzzy goal for the decision vectors i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- International Journal of Information Technology and Decision Making
دوره 12 شماره
صفحات -
تاریخ انتشار 2013